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ABSTRACT 


This paper introduces several data analysis routines 
that were designed for interactive use with APL (A Program- 
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I. INTRODUCTION 


The Naval Postgraduate School acquired APL (A Program- 
ming Language) from IBM in 1974, Since that time more and 
more students and faculty have become familiar with the eX- 
tensive and efficient capabilities of APL and have been 
Putting these features to good use. With the acquisition of 
APL came several extensive library routines that are both 
well documented and varied in scope. However, on close ex- 
amination of these library routines it was found that statis- 
tics and data analysis were areas where some additions would 
Meepartictamly useful. 

Because of the efficiency and ease of APL in manipulat- 
ing vectors, matrices and arrays, it is ideal for use in the 
area of data analysis. After a complete and thorough screen- 
ing of the existing APL library routines pertaining to 
data analysis, it was found that by adding six additional 
data analysis routines to the present library, the Naval Post- 
graduate School could enhance its present APL capability 
and provide the student and general user with a more varied 
and flexible tool for analyzing data. 

To this end the purpose of this thesis will be (1) to com- 
pletely describe the six data analysis routines added to the 
APL library, (2) to explain the features and capabilities of 
each of the routines and (3) to demonstrate the use of each 


Of the routines with "real world data". 





The data to be used in this paper has come from two dif- 
ferent sources. The first source of data was from tests per- 
formed jointly by IBM Germany and the German Public Telephone 
Network on errors in transmission of binary data on telephone 
lines (Lewis & Cox, 1966). From this source two sets of data 
are used and’each data set contains the times between errors 
in binary bits transmitted over telephone lines. The first 
data set contains 672 elements (times-between-errors: actual- 
ly number of bits between errors) and will hereby be referred 
to as "telephone data 1". The second data set contains 736 
elements and will be referred to as "telephone data 2". The 
second source of data was obtained from percent overrun or 
underrun on selected military contracts during the year 1950 
(Dixon, 1973). This data set contains 22 elements and will 


be referred to as "cost overrun data", 





Pie tn SHOGRAM ROUTINE 


eee Deon ben 1 ON 

The first routine to be presented is the histogram rou- 
tine which is used for estimating from given data the proba- 
bility density function f(x) of a continuous random vari- 
able. The current APL library has several small histogram 
routines that are general in nature but lack the overall de- 
tail necessary for good data analysis. For this reason HIST 
(histogram routine) was created. HIST represents the adap- 
tion and modification of the fortran library version of 
Pewee vwiniven was developed at N.P.S. by D. R. Robinson 
under the guidance of Professor P.A.W. Lewis. By modifying 
and adapting HISTG/F to APL the power and efficiency of 
the APL language could be put to full uSe. 

A complete description of how HIST operates is con- 
tained in the variable HISTHOW. If the users APL work- 
Space is properly loaded (see section IX.B. for workspace 
loading procedures) all that is necessary is to type HIST- 
HOW. The user then receives the following printed response 


on the terminal: 
HISTHOW 


OYNTAX HIST 


Peeeeumeeere yom OU TO LTNTERACTIVELY OBTAIN A HISTOGRAM OF 
eer eeereenGewiTH A SET OF BASIC DESCRIPTIVE STATISTICS. 
Peo eteov weet or HAS THE FOLLOWING CAPABILITIES WHICH ALLOW 
7OU: 


ao 





(1) 


(2) 


BeeeOrrtONTOr A TITLE POR YOUR HISTOGRAM 


(oa) 
2m er Tom POF DISPLAYING A SMOOTHED EMPIRICAL DENSITY 


FUNGTION OVER THE HISTOGRAM 


(3) THE OPTION OF SCALING AND SELECTING THE NUMBER OF 


Ceiba On 1OUR HISTOGRAM 


(4) THE OPTION OF SELECTING AN INTERVAL AND PERFORMING A 


HISTOGRAM ON ALL THE DATA POINTS OR CONDITIONALLY 
BELECTING AN INTERVAL IN THE RANGE OF THE DATA. 


CS thE OPTION OF HAVING YOUR OUTPUT APPEAR ON THE 


OFFLIWE PRINTER OR ON YOUR TERMINAL 


eeu eee! TOU wWibL BE ASKED TO DO THE FOLLOWING: - 


Bree OURMOATA ITN VECTOR FORM - YOU CAN TYPE YOUR DATA 
PN SINGEY ORF YOU CAN TYPE THE NAME OF A VARIABLE THAT 
HAS YOUR DATA IN IT. YOU MUST ENSURE THAT YOU HAVE AT 
Poe Omen Ame OLVGo IN YOUR VECTOR AND THAT THERE I5 
SOME DIFFERENCES IN THE DATA POINTS (MAX SIZE OF INTEGER 
Veer oArP Er HOAs 2500 , MAX SIZE OF REAL VECTOR @ZI5 
ZC Arter eyYOU HAVE ENTERED YOUR DATA YOU WILL BE 
ASKED 

Pr OUNOMOnRe AN OMOOTHED BAPTHICAL DENSITY FUNCTION OR 
VO pemeMPeTRPOCAR DENSTTY FPUNCTION WHEN PLOTTED GIVES 
Booey aA AMOR E BAACT PICTURE OF THE DATA THAN DOES 
THE HISTOGRAM ALONE, ALTHOUGH THIS FEATURE IS SLIGHTLY 
Bmore es SHE PHECISLON WHICH CAN BE OBTAINED WITH TRE 
Too rieenneeeAr Gt | FiNe PLOT [5S NOT PRESENTLY AVAILA- 
BEGG SaoteeNPomwolortem). THE SHOOTHED EMPIRICAL DENSITY 
om ee eee THERE EATION (LEWIS ,LIU,ROBINSON, AND ROS- 
PROUT seo? > HOSENBLATT,1956 ) 


VCO eB CN) 
Zz 


Poets LHE NUMBER OF DATA POINTS, B(N) IS A BAND- 
wee CE FUNCTION, 


B(N) = RANGE + SQRT(N) 
AND W IS A WEIGHT FUNCTION, 


W(Z) 0 EP | 2 


eal 2: OTHERWISE 


ie 





F(Z) IS COMPUTED FOR VALUES OF Z BETWEEN THE MAXIMUM 
AND THE MINIMUM OF THE SAMPLE AND PLOTTED OVER THE 
HISTOGRAM USING THE SYMBOL -F-. THE RELATIVE FREQUENCY 
Pome vel HE LEFT OF THE OUTPUT REFER TO THE HISTOGRAM, 
peer ei OTHE DENSITY FUNCTION. AFTER THIS QUERY YoU 
WILL BE ASKED 

meer cumeeorne TO TITLE YOUR HISTOGRAM. IF YOU ELECT fO0O 
Peewee OCnmr tT OTOGRAM, SIMPLY TYPE YOUR TITLE, ENSURING 
Pope OUmeahIEe Io MORE THAN ONE CHARACTER IN LENGTH. 
Povo tee oO  DESTRED JUST HIT THE CARRIAGE RETURN. 
AFTER THE TITLE QUERY YOU WILL BE ASKED . 

(4) IF YOU WANT TO SET YOUR OWN SCALE AND THE NUMBER OF 
CELLS. YOUR RESPONSE MUST BE A VECTOR OF 3 £=ELEMENTS 
eo Nt lS THe NUMBER OF CELLS YOU DESIRE, 
[eigen eee een 6CLLNITECERD6UBETWEEN6U1006cAND6hU28l—CUW,S OUCOTHE 
DECOND ELEMENT 15 THE LEFT SCALE POINT AND THE THIRD 
Poni ome niGHT SCALE POINT (HIST DOES NOT REQUIRE 
DEAD NGWHRVINTBRVAL BE DIVISIBLE BY THE NUMBER OF CELLS). 
IF YOU WANT HIST TO AUTOMATICALLY SCALE AND PICK THE 
eae eemoneulD TYPE THE VECTOR Ome O. . APT ER meee U 
Hav eee eeorne OCH SCALING TECHNIQUE YOU WILL BE ASKED 

omer OCCmvANT MOAT A POINTS NOT INSIDE THE SCALE LIMITS 
INCLUDED IN THE HISTOGRAM ROUTINE. MOST HISTOGRAMS LUMP 
Pee AmrCuNTS gaAl FALE OUTSIDE THE SCALE LidMiTS IN THE 
PID MGmeponmmemmownvEh, HIST GIVES YOU THE OPTION Ce 
HieomveminnwmmoneweXCLUDING THEM, I.E. OF OBTAINING A 
ne eGaatmemOnme he CONDITIONAL DENSITY. AFTER YOUR RE- 
SPONSE TO THIS QUERY YOU WILL BE ASKED 

ome Comey sreun OUTPUT TO APPEAR ON THE OFFLINE PRINTER 
CC meow nemyAee tr YOU SELECT THE OFFLINE PRINTER 
THE NEXT RESPONSE YOU WILL RECEIVE ON YOUR TERMINAL IS 
Soto maneworNteOSPEINTER -. YTHIS RESPONSE WILL TAKE 
SEVERAL SECONDS AND AFTER IT IS RECEIVED YOUR TERMINAL 
Poet oeomevnemeh USE. HOWEVER, IF YOU ELECTED TO 
HAVE HeUnmneDeOGcnAm PRINTED ON YOUR TERMINAL THE 
PRINTING WOULD BEGIN IN JUST A FEW SECONDS BUT WOULD 
Peon ee AND 6006 6UMINUTES TO COMPLETE. 


Peet ovING BASTC DESCRIPTIVE STATISTICS ARE COMPUTED 
PeeePHiNTED OUT BY HIST. 
MEAN, MEDIAN, TRIMEAN, MIDMYEAN, MODE 
GEOMETRIC AND HARMONIC MEANS (POSITIVE SAMPLES ONLY) 
[ween eee tANOARD DEVIATION, COEFFICIENT OF VARIATION, 
RANGE AND MIDSPREAD 
iemeeomerounl a CENTRAL MOMENTS, COEFFICIENTS OF SKEW- 
WEoS AND KURTOSIS 
MAXIMUM, MINIMUM AND 5S SAMPLE QUANTILES 


ee 





MeoeeeeroON, THE MEAN IS DISPLAYED ON THE HISTOGRAM BY A 
VERTICAL COLUMN OF =i > AND THE QUARTILES BY COLUMNS OF 
DOTS . 


INTERPRETING PRE OUTPUT 

MaDe ENiEnONSG OF THE BASIC STATISTICS COMPUTED BY HIST 
ARE LISTED BELOW. PAGE NUMBER REFERENCES ARE TO THE CRC 
STANDARD MATH TABLES, 19TH EDITION (1971). 


MEAN AVERAGE OF THE SAMPLE (P 554). 
MEDIAW Meee Ue OF THE SAMPLE, IF THERE ARE AN ODD 


NUMBER OF SAMPLE POINTS, OR THE AVERAGE OF THE TWO 
MIDDLE VALUES FOR AN EVEN NUMBER OF POINTS (P 555) 


SAMPLE THE Q(1)=.25, Q(2)=.50, AND Q(3)=.75 POPULATION 
QUARTILES QUARTILES ARE Poe og weuLroN TO THE EQUATION 
PROB (X s X(Q(I))) = Q(T) ato Lhe GAME EE 


Meopee Tob ow WHICH ESTIMATE THE POPULATION QUARTILES 
ARE, THE J2H ORDERED VALUE IN THE SAMPLE, WHERE 
J = € Q(I)xN J] + 1. WHERE N = SAMPLE SIZE. 


TRIMEAN Gree eewgowet Jo + 20(2) + Q(3)), WHERE THE Q(I) ARE 
THE QUARTILES. 


MIDMEAN eeeeeOr MAGE THE SAMPLE VALUES BETWEEN THE 
UPPER AND LOWER QUARTILES. 


MODE emeeaeeamerOINT THAT OCCURS MOST OFTEN (IF ALL THE 
DAP ASEOPNTaeANRE DIFFERENT OR IF THERE ARE MORE 
iiaweeso0 DATA POINTS THE MODE WILL NOT BE PRINTED. 
omenomonmmuone MODES OCCUR HIST WILL PRINT THE 
FIRST MODE.) 


MIDRANGE AVERAGE OF THE MAXIHWUM AND MINIMUM. 


emer erk ic (P 554). 
MEAN 


eeRMONIC (P 555). 
MEAN 


PARPANGE SS (PeS57). UNBIASED ESTIMATORS FOR VARIANCE AND 
STANDARD DEVIATION ARE USED. 


peauieAdo. (P 557). 
DEVAL ION 


3 





COEFFICIENT OF VARIATION = STANDARD DEVIATION + |MEAN| WHEN 
Pipe AN Ch SO THAN 1E-30, THE COEFFICIENT OF 
Vo eer ON to SET TO ZERO. 


MEAN Gamo soem ne AVERAGE OF YHE SUM OF THE ABSOLUTE 

DEVIATION DIFFERENCES BETWEEN THE SAMPLE VALUES AND THE 
MEDIAN. 

RANGE MAXIMUM - MINIMUM (P 557). 

MIDSPREAD Q(3) - Q(1) , ALSO CALLED THE CeO Au rs 17 
DISTANCE. 

M3 Pie O CENTRAL MOMENT. UNBIASED ESTIMATOR IS USED. 
Ge 558) 

M4 Peuree CENTRAL MOMENT. UNBIASED ESTIMATOR IS USED. 
C2558) 


COEFFICIENT OF SKEWNESS Me = SCS TUE V )*x3 

BOeErPICiENT OF KURTOSIS GeV EMEN CORD MOE V KH ) = 3 

BETA! BiiseomeotmiaAreh OF THIRD CENTRAL MOMENT. CAN SBE 
USED IN TESTING FOR NORMALITY. (BIOMETRIKA TABLES 
ermouAruolrCIANS,1966). 


BETA2 BIASED ESTIMATE OF FOURTH CENTRAL MOMENT. (BIOMET- 
MA TABLES FOR STATISTICIANS,1965). 


MAXIMUM LARGEST SAMPLE VALUE. 
MINIMUM SMALLEST SAMPLE VALUE. 


SAMPLE Pie -QUANTILE, X(a), IS THE SOLUTIOW TO THE £28. 
wormitoho sPROBABTLITY (X = X(a)) = a 


With this complete description the general user should 
be able to take full advantage of HIST and put to use all 


Ice OD EONS . 


14 





Eevee Ge With TELEPHONE DATA 1 AND TELEPHONE 
Vere ee OFFLINE S ALL DATA, ECDF, AND TITLE 


HIST was now used on two sets of data. Both telephone 
data 1 and telephone data 2 were first used with the offline 
printer demonstrating the title option, the empirical den- 
sity function option and using the conditional option with 
any data points outside the designated interval being lumped 
into the end cells. When HIST was typed the following re- 


Sponses to each of the queries were entered. 


HiT 
tea lv VECTOR FORY 


DOO AL 1 


Pour oOmw ena eA ON OOTR ED RVPTRICAL ORNSIPY FUNCTION ENTPR 
A Meme om oOetOr VWAVT FP PNTER A oO 
ie 


i 


rem A eevOerTG: «8 YOUR FHISTOGRA' TYPF YOUP TITLF, 
oem Cm oO, WANT A TITLE JUST RIT THE CARRIAGE PFTUPN, 


PRES PHONE DATA 1 


Pe ONSET TUE VUNSFR OF CELLS AND THE SCALE 

Peete we WURIBER OF CELLS (Al INTEGER BFTWFFN 10 AND 28) 
Been toes! Be DPACHE AND THEN YOUR LERP SCALF POINT FOLLOWED 
Pee seach AND THEN YOUR RIGHT SCALE POINT. HOWEVER, IF YOU 


Pee ote oD AUTOMATICALLY SCALE ENTER ORG 0 
ul: 


a 
Eee 


28 0 20000 


ero meerOUNEAVE SET YOUR OWN SCALE, TO JFINCLUDE DATA 
epee sich BE OUTSIDE YOUR SCALE LI4ITS I PRE FY 
Cerio «tee oro mo GUATED AUTOSCALF ALSO, TYPF 
er etoveyEn., YOU PO NOT WANT THE DATA OUTSIDE TRE SCALE 
mee nomenone On FY THE HISTOGRAI!, TYPE —-. 


U 


i 


TF YOU WANT YOUR OUTPUT TO APPPAP ON PHP OPPLINE DRrvper, 
TYPE 1 ., JP YOU WANT YOUR OUTPUT "0 APPEA2 ON YOYP 
TERMINAL, TYPE 09 . (NOTE IF yoU TYPFD OQ 8” SYRF YOU? 
DaeEWAbs CARRIAGE PAGE SETTING IS ON THRE MAYIIIM prom) 
= 

1 
HISTOGRAM SENT TO PRINTER 


5 





Note that telephone data |] was contained in the variable 
TELDATI] and that the number of cells chosen was 28 with the 


left scale point being O and the right scale point being 
A000. 

After the response - HISTOGRAM SENT TO PRINTER - was re- 
ceived. HIST was again typed under identical conditions 
and telephone data 2 was entered through the variable 


EEDA 2. 


eis 1: 
Beier OATA IN VECTOR FORH 
QO: 

LEE DAT 2 


eo oOo A AweMOOTHED BHPIPICAL DYNSTTY FUNCTION FNTFR 
A Moree ec OVOP WANT If ENTER A 0 
is: 


1 


ee Teer OTT LE 6©6YOUR AISTOGPA' TYPF YOUR TITLF. 
a femvommotey ANT A TITLE JUST HIT THR CARRIAGE RVTPURY, 


MEE PHONE DATA 2 


Memeo oevAye woe oh, THE NUMBER OF CELES AND THE SCALE FNTER 
Peet oP eae NUMBER OF CELLS (AN INTEGER BETWEEN 105 AYD 28) 
eee AO PACE AND THEN YOUR LEFT SCALR POIVT FOLLOWED 
BeemomoeACeE AND THEN YOUR RIGHT SCALE POT?IT. HOWEVER. LE eyo 
eee ee oT TO AUTOVATICALLY SCALE ENTER O2Oe 0 
ar 

Zo 0 20000 


GIVEN THAT YOU HAVE SET YOUR OWN SCALE, TO INCLUDE DATA 
Eee oeTHAT MIGHT BE OUTSIDE YOUR SCALE LIYITS .IN THE &ND 
pees rem aE YOU DESIGNATHD AUTOSCALE ALSO, TIPF 

. IF HOWEVER, YOU DO NOT WANT THE DATA OUTSIDE THE SCALE 


brurrs AVCLUOE D IN emo OsRA. 1, FY PE 9 
J. 


fad 


i 


oO wey OUR OUTPUT TO APPEAR ON THRE OFFLINE ORIITEP, 
es Es YOU WANT YOUR oUuTPUT 79 APPFAR ON YOU 
Teva, TYPE 0 . (NOTE ITP YOU TYPFD O RF SUR YOUR 
TERMINALS CARRIAGE PAGE SETTING TS ON THF MAYIMU™ WIOPY ) 


z 
PeeOCnAy StT TO PRINTER 


6 





Now by looking at figure 1 (output for telephone data 1) 
and figure 2 (output from telephone data 2) the similarities 
and differences in the histograms can be compared. Without 
getting into specifics, the empirical density function plot 
Seems to indicate that both sets of data are similar. How- 
ever, the one time-between-errors dominate the data; a more 
detailed discussion of this data and its analysis is given 


miesection VIII. 
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C. USAGE WITH TELEPHONE DATA 1 AND TELEPHONE DATA 2, ON 
LINE; CONDITIONAL DATA BETWEEN 2 AND 140, ECDF, AND TITLE 


Because both sets of data contain: 
(1) a large number of elements, 


(2) a large number of times-between-error equal to ] 


(this becomes more apparent when HISTLIST is 
described), and 


(3) the range of the data sets is so extensive, 
it would appear that the conditional option available on 
HIST could be used to eae if the two data sets are in fact 
Similar over a smaller interval. This in fact was done us- 
ing the on line printer option, the empirical density func- 
tion option, the title option and the conditional option 


with any data points outside the designated interval excluded 


from the histogram, 


rot 
Bre bre DATA DH VECTOR FOR" 
C: 
eo Ad a 
Ooms OOM AN?T A SHOOTHED EMPITPICAL DENST?TY FUNCTION FNTER 
A a : memo mDOFAOT WANT IT ENTER A 0 
Cl; 


1 


Ome eer One? 27h8 YOUR AISTOGR4+ TYPE YOUR TITLE. 
oe eee Comey OrewWANT A TITLE JUST HIT THE CARRIAGE PFTURA., 


TELEPHONE DATA 1 BETWEEN 2 AND 140 


IF YOU WANT TO SET THE NUHBER OF CELLS AND TRE SCALE FNTFR 
orem eh OF CELES (AN INTECER BETWEEN 10 AND 28) 
een eee AN SPACE AND THEN YOUR LEFT SCALE POINT PFOLLOWFD 
Pee ee eee EY YOUR RIGHT SCALE POINT. HOWEVER, IF You 
Wawtee ol TO AUTOMATICALLY SCALE FNTER 09 0 

: 


28 2 140 
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Gee HAT YOU HAVE SET YOUR OWN SCALE, ro TVET OE 7 OAT A 
Memeeoest ar “MIGHT BE OUTSIDE YOUR SCALE LI'“ITS Ei” OE ere 
GCelas . TYPE a eee SP CHATED  AUTOSCALE ALSO, TYPE 
i ; eee eee YOU DO NOT WANT TRE PATA OUTSTDF THE SCALF 
Doe Tro INCLUDED IN THE FHISTOGRAN, TYPE 8) 
OQ; 


0 
oman YOURS OUTPUT TO APPRAR ON THRE OFFLINE PRIYTER, 
TYPE 1 . eae CU) WANT YOUR Tee PO ADDF AR ON YOUR 
feerere NAL, TYPE 0 . CVOTE TF YOU TYPED 0 Sheesh mou 
Heme evAbo CARRIAGE PAGE SETTING IS ON THRE MAXIMNU?! WINTH) 
O: 


0 


Note that the same variable TELDAT1 is used but this 
time the interval was between 2 and 140. Also, the - 
HISTOGRAM SENT TO PRINTER - was not typed because the on- 
line printer (terminal) option was employed. 

After the output for telephone data 1 was printed HIST 
was again typed and telephone data 2 was entered under iden- 


meal conditions. 
Fags 


meee DATA PY VECTOR FOR™ 

ie 

- mE LDA 

a eee ATT A GMOOGEED E’PTRICAL DORNSITTY FUNCTION ENTOR 
A ema DOMIOT WANT IT ENTER A 0 

ae 

me ; 


Romero TRTLE YOUR HISTOGRAM TYPE YOUR TITLE. 
ao Oe oeeNOr VANT A TITLE JUST HIT THE CARRIAGE RETURN. 


MEP PHOUR DATA 2 BETWEEN 2 AND 140 


IF YOU WANT TO SET THE NUMBER OF CFLLS AND THE SCALE FNTER 
FIRST THE NUMBER OF CELLS (AN INTEGER BETWEEN 10 AND 28) 
FOLLOWED BY A SPACE AND THEN YOUR LEFT SCALE POINT FOLLOWED 
BY A SPACE AND THEN YOUR RIGHT SCALE POINT. HOWEVER, IF You 
WANT HIST TO AUTOMATICALLY SCALE ENTER 00 0 

ime 


—d © 


28 2 140 


2 





peeve eee CU HAVE SET YOUR OWN SCALF, TO INCLUDE DATA 
Mmemeeeome aA etiGHr BE OUTSIDE YOUR SCALE LIMITS IN TE END 
Oeigso, IY PE eeu OG oTGVATED AUTOSCALE ALSO, TYPF 
eon ety YOU DO NOT WANT THE DATA OUTSTINF THE SCALP 
ee” UNCELUDED IN THE HISTOGRAN, TYPE oO. 
0 

ee comme YOUR OUTPUT TO APPFAR ON FHRE OFFLINE PRINTFR, 
eee Peer OU WANT YOUR OUTPUT TO APPEAR ON  YOUP 
merMIiNAL, TYPE See CN OTE Tr YOU TYPED 0 BF SUPE Wey e 
Meme AboO CARRIAGE PAGE SETTING IS ON fHRE VWAXIMU™" WIDTH) 


fl: 
0 


Figure 3 (output from telephone data 1 between 2 and 
140) and figure 4 (output from telephone data 2 between 2 
and 140) now appear quite different in shape based on the 
eMpuried) density function plot. This 18, again, because 
of the extensive range of the data (85,993 for telephone 
data 1 and 67,271 for telephone data 2) and the large number 
of times-between-error equal to one. Both sets of data are 
actually discrete, only occurring at multiples of 1, but as 
an initial analysis the data sets were treated as continuous. 
Thus, by employing the conditional option available on HIST 
differences in the’ two sets of data become quite apparent 


whereas before, the differences were not so easily detected. 
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Cee ori NG eR OU TNE 


pee DESCRIPTION 

The second routine presented is a listing routine. APL 
has a function that will automatically sort the data and 
print the results. However, the unique feature of HISTLIST 
(listing routine) is that it takes advantage of like occur- 
rences in the data and prints the ordered data ascendingly 
in a compressed form. This becomes highly useful when list- 
ing a large number of data points that contain multiple oc- 
Cmpencessslt 1S d1So a tool for finding multiplicities in 
Supposedly continuous data, and a probability function esti- 
mating routine for data which is known to be discrete. 

A complete description of how HISTLIST operates is 
contained in the variable HISTLISTHOW. When the user types 
Teel oiiowem ane TOllowing response 1S printed on the 


terminal: 
Mies itils THOW 


SlhAL  8iST LIST 


oem A nIGHEY CONVENIENT WAY TO LIST YOUR DATA. 
Paonia YOUR DATA, ORDERS IT AND COMPRESSES If. FOR 
EXAMPLE, IF THREE DATA POINTS WERE ALL THE SAME VALUE 
HISTLIST WOULD JUST PRINT THE VALUE ONCE AND THEN PRINT THE 
NUMBER OF OCCURENCES OF THAT VALUE. HISTLIST WILL ALSO 
PRINT THE SERIAL NUMBER OF THE DATA, THE PERCENTAGE THIS 
SAMPLE VALUE IS TO THE WHOLE SAMPLE, AND A MALL HISTOGRAM 
(STARS) SHOWING RELATIVE PERCENTAGES. EXAMPLE: 6 4 4 3 4 


palo. 
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oR. NUM. ORDERED DATA NUMBER OF OCCURENCES Pai CEN 


1 a i kk kek a0 
2 ub 3 kak kkk kkk kK 200 
E 6 1 ke ke te 0 


HISTLIST IS IDEALLY SUITED FOR A LARGE SAMPLE THAT COULD 
POSSIBLY HAVE A LOT OF LIKE OCCURENCES. HISTLIST FURTHER HAS 
THE ADVANTAGE OF BEING USED WITH EITHER THE OFFLINE PRINTER 
OR THE USERS TERMINAL. 


B. USAGE WITH TELEPHONE DATA 1 AND TELEPHONE DATA 2 OFFLINE 
HISTLIST was used with the title option and offline 
Printer option on both telephone data 1] and telephone data 2. 
When HISTLIST was typed the following responses to each of 


the queries were entered. 


Fel S? Galo .. 
Pete oe eee To TRE SERTAL NUMBER OF THE COUP PRS SE) 
Wena eon Dee eD DATA COMPRESSED, AND TUF NUMBER OF 
Gen peemOCOURENCES . ENG err OUR DATA EU SVECTOR FOR . 
Mo: 

PEEOALT 1 


eee FU OO) Tig «6©6YOUR DATA TYPE YOUR TITLE. 
PeeovumooevOmenAda A TITLE JUST AIT THE CARRIAG® 
meray . 


a4 a 


Peco BALA 4 


Poe ComeanteyOUR OUTPUT TO APPFAR ON THE OFFLINE 
peer Pe et” | rE YOU WANT YOUR OUTPUT TO APPEAR 
weeeouR THRAINAL TYPE 0 
a: 
2 
ioe oeNT TO PRINTER 


After the response - HISTLIST SENT TO PRINTER - was re- 
ceived HISTLIST was again typed and telephone data 2 was 


entered. 
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Heo oT 
Pere ee tay > THEOL RTAL NUMBER OF THE COMPRESSED 
Cee CO aTUS RED DATA COMPRESSED, AND THE NUMBER OF 


eee OCCURENCES weNTER YOUR DATA IN VECTOP FOR, 


Ll: 


MEG AL 2 
me aoe WANT TO mate YOUR DATA TYPE YOUR SETI ae 
ieee OonOT TANT VA, TITLE JUST HIT THE CARRIAGE 
RETURN. 
TELEPHONE DATA 2 
IF YOU WANT YOUR OUTPUT TO APPEAR ON TEE OR Ria & 
PRINTER TYPE i meee Oy WANT YOUR OUTPUT TO APPEAR 
ON SVOUR TERIIINAL TYPE 0 
U: 

a: 
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Looking at figure 5 (output with telephone data 1) and 
Figure 6 (output with telephone data 2) the T1Stingsmoen athe 
two data sets can be compared. It can be seen that both 
telephone data 1 and telephone data 2 contain a large number 
of multiple occurrences of the number one and the number two. 
In fact 19% of telephone data 1 is the number one and 24% 
of telephone data 2 is the number one. Also, telephone data 
2 has many more multiple occurrences in the 120 to 130 range 
than telephone data 1. This was quickly apparent when one 


looked at the stars to the right of the ordered data. 
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FIGURE 6C 


ee ed ge mad ce i OY dd i ed a at ge mt (TD tb ot et tt > Sa ne ae ee Gee ae at Dae a remem ee Oe re ae rr et ee ee or coe? ped ond ond 
Cane eae peat ie Neen aed Oo Sa SY CGD Big esa red een Co a em haere ae een Oar Una Comcast cage ~ : —_—- ae 
BAF ZONA 377 ES 556 F595 AE F394 9597 99 RI DDG A DSR A 4 aR RE ae Fe 
aMarseG 6) @ tae © 6 © © 0 66856 6 6a 6 6 48 6 6 606 Se 5e 6 66 6 606.6 eo he 0 6 0h a 6 6 6 68 6-6 6 6s oe eee ee ee er eee ee 
Gna IN Soe Oe A DOS Se DOD A nD DT Ae OG pee ee a = SO Oe Sf oe ok 


4 ‘i = : 
: ‘ = ~ 


e 06 
~s- 


at tt tN) i Om ONY i Od i bi bt ON i 8 a 8 i br ati ti ii bd nd a dN md nt rn tn i i 8 i i te i 8 kd hr i i dg dd a pd ot ot tt ee I dt -  t —t 


De Ot et O90 2 9999 OC 722 Ss Sn ae a oo re ae Se ee eo Ol OS AS BOC SSAA TTS Ske Se CIS 
es ca ca a ame Chica co aga). faba) Sep CaN ony ont ap FV fe ean) cen oy CaN a Rens DS OO oe oe ee Oh ae oe eee aS Se ao a aD ODDS 2 OPO 2 IO OF SOD aS oft oS 
NGG ays) eas) a) Saat) 22POID ia a ed dene a oe ey as ee ee ee 8 ey ee ee a ae) co tae se ees ay” kd oY pe cp od Co os wa ot a ae de ale ae 
Oe 2 IO TO IO 3 SO ee ae oO 2 2S Bee AI See as ‘2 Ee NG ee isis) care ee Colores hd oe ak CS er ee oa eS ae 
DD Ft HDD PINION FIO oP I I Oo 0 I SS PIC I en S OO OS B02 8 a) Di Oe 9) ts Se 9? 
ADDED IPOD at LD PDI PODS IOP! INS Me POD DD POI RIS TS Id IPI ISIS DOD PEDO LUD IN DID I SII IOI Pt DUI De FP ID 

e@e0eouvu54se@etrt#eeoeeeteteeenvoee@envreeeteerteetetetee @ 4 


e@®@eeee2e7e*eseeseereteeeeeeteeeeeeeeteeteeetreeteeeteteeeetetoenvrseerteseet @ & @ * @ 
DHA OL OM DIN AD AO CUMOAUAPLS FF FINO EINE SIN TUN OAT UNE (NE MO TIN ACO WDIADAM VAL D DUN FINA OFFTH NON Sel DDW Of DIN HW OILS Uv ery 
= PeUAl QUIS QUIW OW At OTN AD AY DEI AINE RIC UO BUOY OUI OU DE UD ACI AIC EOP BOD WD LO A PP OP Heer ay Pr 
POR OLAS OID Ha AMN QUIN GLO T AELT TUINUMOAINUEV IAIN WO 2D ER RE Em F DM TDI OLN USER 739-69 A RAINIQVKQIQAUTI ED FF FFT OM UDP OR ASIN COUN TDD UTNE IR IVUA OF Dag PF DTK 

Oh ht tt eh td It Ht tet tt It A tt tet tt IOI ONAN CIN NNN AN AIOAIN NAA OCICIM MOAI FINA CONFI Meare .t FF FF FINN OO 


NOM DWP DAUMOSTMN ORD BAUM TIA OH ODKRANMSF NO DH BDANMSFIN OM DPFOANM SNR DD DANA FIN OF OFDMHAANO-FUN OM DH QANMSFN OF DM SANN PW OM ORDA 
FRPP PD 7O3DD DDD At 4h 8 HANAN AN AIN AIRY EVO AYO IAEA EN FF FATT FP PTD NUNN UD OU OU OD O00 ORR RR RRR DDD VV VID DDD YH 
INUININUININOO0DO00DD0 ODDDDOVODODDOOODOD ODODVDDODODDDDOOD DOOD DODODDDONOODONDOVODONDDNONDNDOODOODDDDODONDDDVOD0NDDNN 9D 0000 000.0 


S13 





FIGURE 6D 
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In addition, HISTLIST saved on printing time and paper. 
syeprinting the data in compressed form HISTLIST saved 
printing 448 lines (6 additional pages) in the case of tele- 
phone data 1 and 419 lines (5 additional pages) in the case 
Gace rephnone data 2. Thus, HISTLIST not only gives the 
Pewenore intonmation than an ordered listing of the data, 
but also is cost effective in terms of printing time and 
peer Used. Finally, note that it 1S not possible to look 
at the data in as much detail with routine HIST as with 
HISTLIST. If the data is continuous and there are no multi- 
oremcres, then HISTLIST gives only this information-and 
an ordered listing of the data. The shape of the density 


function can best be seen (estimated) in using routine HIST. 
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PV o> SEC PRG ING eS ROUTeENE 


A. DESCRIPTION 

The third routine presented is the sectioning routine, 
HISTS. HISTS (sectioning routine) gives a way of assessing 
the variability of estimates of descriptive statistics from 
sample data. It is essential that the data be in random 
Cader . 

The basic idea is as follows: Assume we have m_ inde- 
pendent observations Vy 2Vo2e+29Vp of a random variable /Y. 
The usual estimate of its mean value wu = E(Y) is the sample 


m 
mean y , where y ae y,/m . Now y is the least-squares 
1= 


] 
estimate of u , and therefore unbiased with variance 


Vani) = oo) m , where g¢ = var(y) . Of course g¢ 1S un- 


known, but we can estimate it from the data with the sample 


variance 


m 
a ] = 
S a na yy (y. = y)° 


i 
i=] 
and then estimate the variance of the estimate y of u as 


Fa 


2 m 
var(y) = — = “arty es (y. - y 
= | 


2 
= ) 
1 


This is the basis for the sectioning routine: here the 
Vac ecmes ciliates Of G€escriptive statistics from the m sec- 


: 
tions of the data and y is the average of the statistics 





From each section. Estimates are assumed independent because 
the original data is assumed to be independent. 

A complete description of how HISTS operates is con- 
tained in the variable HISTSHOW. When the user types HIST- 


SHOW the following response is printed on the terminal: 


HISTSHOW 


SYNTAX HISTS 


Bioto amelLOWsS YOU TO INTERACTIVELY SECTION YOUR DATA AND 


Meee ae VANTADILITY IN BACH OF THE DESCRIPTIVE STATISTICS 
BY USING THE SECTIONED SAMPLE DATA. 


WHEN YOU TYPE HISTS YOU WILL BE ASKED TO DESIGNATE THE 
NUMBER OF SECTIONS YOU DESIRE. HISTS WILL THEN TAKE 
THE UNORDERED DATA AND DIVIDE THE DATA INTO THE NUMBER 
OF SECTIONS YOU INDICATE DISCARDING ANY DATA POINTS LEFT 
OVER. FOR EXAMPLE, IF YOU HAVE 301 DATA POINTS AND YOU 
SELECT 10 SECTIONS HISTS WILL PLACE THE FIRST 30 DATA POINTS 
mene fIRSPeOECTION, THE SECOND 30 DATA POINTS IN TRE 
SECOND SECTION AND SO ON UNTIL THE LAST DATA POINT IS 
Oat TED. YOU WILL NOW HAVE 10 SECTIONS WITH 30 DATA POINTS 
men OECTION, 


HISTS WOULD NOW PRINT THE FOLLOWING STATISTICS ON EACH OF 
THE SECTIONS: MEAN, MEDIAN, VARIANCE, STD DEV, COEF VAR, 
SKEWNESS, KURTOSIS, MINIMUM AND MAXIMUM, IN ADDITION, THE 
ABOVE STATISTICS WOULD BE PRINTED FOR THE UNSECTIONED DATA 
TO ALLOW FOR COMPARISONS. 


PINALLY, HISTS WILL PRINT (1) THE MEAN OF THE SECTIONED 
Ares. FOR EXAMPLE, THE MEAN FOR SKEWNESS WOULD BE 
BACH SECTION VALUE FOR SKEWNESS SUMMED UP AND DIVIDED BY THE 
WUMBER OF SECTIONS. (2) THE VARIANCE AND STD DEV OF THE 
Poem eo ata STATISTICS. AND, (3) THE STD DEV DIVIDED BY 
THE SQUARE ROOT OF THE NUMBER OF SECTIONS, WHICH ESTIMATES 
eo nAmOARD DEVIATION OF THE STATISTICS. 


Moe y htodo WILL GIVE YOU AN UNBIASED ESTIHUATE OF 
THE VARIANCE OF THE SAMPLE MEAN, MEDIAN, VARIANCE, STD DEV, 
Perey An, ohfeiboo AND KURTOSIS FROM USING THE SAMPLE 
Poe Or THE SECTIONED DATA. WITH THIS RESULT, CONFIDENCE 
wee Ase CAN ALSO BE OBTAINED FOR EACH OF THE ABOVE STATIS- 
Deen ow eePOTeMATES FROM THE SECTIONS ARE NORMALLY DIS- 
PeeeOlepe. Hiots IS BEST SUITED FOR LARGE AND MODERATE SIZED 
SAMPLES; FOR SMALL SAMPLES JACKNIFING SHOULD BE CONSIDERED. 


Sa 





B. USAGE WITH TELEPHONE DATA 1 

HISTS was now used on telephone data 1 to assess the 
variability in the mean, median, variance, standard devia- 
tion, coefficient of variation, skewness and kurtosis. When 
HISTS was typed the following responses were entered (see 
figure 7). 

The 672 data points of telephone data 1 were broken down 
into 16 sections with 42 data points per section. Because 
of this breakdown no data points were discarded. 

The unsectioned statistics printed can be compared with 
the values printed by HIST (figure 1) and are in fact the 
Same. Providing that the estimates are normally distributed 
(this can be checked with the normal plots, described later), 
confidence intervals for each of the statistics (mean, median, 
variance, standard deviation, coefficient of variation, skew- 
ness and kurtosis) based on the t-statistic can be obtained 


in the following manner 


Vat 
wW 
<4 


5 


© (1 =350) , (m-1) 


Here ve licmene mean or the sectioned data statistics (ob- 


tained from column one under summary for sectioned data); 
S- 


Yn is the standard deviation of the sectioned data statis- 


ym tic divided by the square root of the number of sections 
(obtained from column four under summary for sectioned data); 
imme snumber sections chosen; and, eee Va Gme ipomee ie 


]l-4a quantile of the t-distribution with m-1 degrees of free- 


dom. 
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Pee NUERPRETATION OF RESULTS 

As an example, a confidence interval for the coefficient 
of variation was obtained in the following manner. The mean 
value of the coefficient of variation for the 16 sections is 
4.1175 (column 1). The standard deviation divided by the 
Sauaresroot Of 16 is .31128 (column 4). Using oa = .05 , 
the t value with 15 degrees of freedom is 2.131. Thus, the 
95% confidence interval for the coefficient of variation for 
Pemepnonemdata | 1S 451175 + (.31128)(2.131) which is 
moeeeo, 4.781). Confidence intervals on the six other sta- 
tistics could be obtained in the same ‘fashion. 

Again note that the use of the variance estimate from 
the Pecevoned data to give confidence intervals is based on 
the assumption that the estimates from the sections are in- 
dependent and normally distributed. The normality will de- 
pend on the number of observations in each section, which 
should be kept large to induce normality. This requirement 
conflicts with the need to make the number of sections large 
to reduce the variability in the estimate of the variance of 
ities stacvistics. 

Another problem is that if the number of observations in 
each section is small, the estimates may be severely biased. 
This effect can be seen in figure 7: note that all of the 16 
estimates of skewness from the sections are smaller than the 


estimate /.1531 from the unsectioned data. 
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V. JACKNIFE ROUTINE 


pee HESCRIPTION 

The fourth routine presented is the jacknife routine. 
HISTJACK (jacknife routine) is another way of assessing the 
variability in the estimates from sample data, and also of 
reducing bias in estimates of the descriptive statistics. 

The jacknife procedure, like the previous sectioning 
method, is based on the assumption that an independent and 
identically distributed random sample Ky 2XooeeesX, have 
come from a population with an unknown distribution function 
Fy (x) . If we divide the sample into r groups, with each 
group containing the same number of elements, we can obtain 
estimates 96 of the descriptive statistics, which we denote 
generically as 8 , in the same manner as previously done 
with the sectioning method. The difference here is that the 
descriptive statistics are computed with the qn group de- 
meweds j=1,2,...,r . We then let 8 (5) De Ener resulioor 


th 


the descriptive statistic estimate computed with the j sub- 


group omitted, and 631] is the corresponding result or de- 
scriptive statistic estimated from the entire sample (no 
group omitted). The jacknife pseudo-values are then computed 


in the following way: 


~w 


Ba = (7) (8544) - (rT) (8, 
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Then we define the jacknifed estimator to be: 


The pseudo-values can be used to obtain variance estimates 

or 6, » and to set approximate confidence limits, using 

Student's t. The idea is that the pseudo-values will be ap- 

proximately independent and possibly normally distributed. 

The jacknifed estimator 6, 1s a sample average so we form 
2 


an estimate sy, of its variance given by the following re- 


lationship (Miller, 1974): 


nC ] ~ 2 
2. ee) 


This procedure is particularly useful if the number n_ of 
data points is small, but it must be used with care. Note, 
that the estimator 6, is designed to eliminate a I/n 
bias term in the estimator 6 

A complete description of how HISTJACK operates is con- 
tained in the variable HISTJACKHOW. When the user types 
HISTJACKHOW the following response 1s printed on the ter- 


minal. 
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HISTJACKHOW 


SYNTAX HISTJACK 


HISTJACK ALLOWS YOU TO INTERACTIVELY JACKNIFE YOUR DATA 


AND ASSESS THE VARIABILITY IN EACH OF THE STATISTICAL 
ESTIMATES BY USING THE SAMPLE DATA. 


WHEN YOU TYPE HISTJACK YOU WILL BE ASKED TO DESIGNATE THE 
NUMBER OF GROUPS YOU DESIRE. HISTJACK WILL .TAKE THE 
UNORDERED DATA AND DIVIDE THE DATA INTO THE NUMBER OF 
GROUPS YOU INDICATE DISCARDING ANY DATA POINTS LEFT OVER. 
POR EXAHPEE, IF YOU HAVE 22 DATA POINTS AND YOU SELECT 7 
e@aechoeatolegACk WILL PLACE THE FIRST 3 DATA POINTS IN GROUP 
eee eerieev Ooms DATA POINTS IN GROUP 2, AND SO ON UNTIL THE 
LAST DATA POINT IS OMITTED. YOU WOULD NOW HAVE 7 GROUPS 
Weeereon OAT ASPOINTS PER GROUP. IF YOU HAD ELECTED TO DO A 
COMP GETE SACKNIFE, THAT IS TYPED 22, YOU WOULD NOW HAVE 22 
G@eevurompeiny 1 DATA POINT OMITTED PER GROUP. 


HISTJACK WOULD NOW PERFORM STATISTICAL COMPUTATIONS USING 
THE JACKNIFE PROCEDURE. THAT IS, BY OMITTING ONE GROUP AT A 
Pees et ANLING WITH THE FIRST GROUP, HISTJACK WOULD PRINT 
THE FOLLOWING STATISTICS: MEAN, MEDIAN, VARIANCE, STD DEV, 
COEF VAR, SKEWNESS, KURTOSIS, MINIMUM AND MAXIMUM, IN 
Peme Tree JHE WADOVE STATISTICS WOULD BE PRINTED FOR THE 
UNGROUPED DATA TO ALLOW FOR COMPARISONS. (NOTE, THE COLUMNS 
GIVE THE STATISTIC ESTIMATED FROM ALL THE DATA WITH OWE 
GROUP MISSING, AND NOT THE PSEUDO-VALUES ) 


PINALLY, HISTJACK WILL PRINT (1) THE JACKNIFE ESTIMATE 
(2) THE SAMPLE VARIANCE OF THE PSEUDO-VALUES DERIVED IN THE 
eee ero t IMATE (3) AND, THE ESTIMATED STD DEV OF THE 
JACKNIFE ESTIMATE DIVIDED BY THE SQUARE ROOT OF THE NUMBER 
OF RCGROUPS. 


AS A RESULT, HISTJACK WILL GIVE YOU AN ESTIMATE OF THE 
VARIANCE OF THE SAMPLE MEAN, MEDIAN, VARIANCE, STD DEV, COEF 
VAR, SKEWNESS AND KURTOSIS USING THE SAMPLE VARIANCE OF THE 
JACKNIFED DATA. WITH THIS RESULT, CONFIDENCE INTERVALS CAN 
BE OBTAINED FOR EACH OF THE ABOVE STATISTICS, AGAIN ASSUMING 
THAT THE PSEUDO-VALUES ARE APPROXIMATELY INDEPENDENT AND 
NORMALLY DISTRIBUTED. HISTIACK IS BEST SUITED FOR SMALL 
SAUPEES . 
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B. USAGE WITH TELEPHONE DATA 1] 

HISTJACK was now used on telephone data 1 to assess the 
Variability in the mean, median, variance, standard devia- 
tion, coefficient of variation, skewness and kurtosis. When 
HISTJACK was typed the following responses were entered. 
(see figure 8) 

The 672 data points were broken down into 16 groups with 
42 data points per group. Again, because of this breakdown 
no data points were discarded. 

The ungrouped statistics printed are again the same 
Values that were printed by HIST (figure 1). Using the 
iacknire method, confidence intervals for each of the statis- 
tics (mean, median, variance, standard deviation, coefficient 
of variation, skewness and kurtosis) can be obtained in the 


following manner; 


~e 


Sree cre) © (1-%a) ,(r-1) 


Here 0, is the jacknife estimate of the sample data (ob- 
tained from column one under summary for jacknifed data); 

S, 1s the jacknife estimate of the standard deviation 

divided by the square root of the number of groups (obtained 
from column four under summary for jacknifed data); r_ is 

the number of groups chosen; and, Ei ete). pe 1s the 

I-%a quantile of the t-distribution with r-1 degrees of free- 
dom. The basis for these assertions about the confidence in- 
tervals using the jacknifing technique is asymptotic and great 


Care must be taken in using them. 
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C. INTERPRETATION OF RESULTS 

To compare the confidence interval obtained for the co- 
efficient of variation using the sectioning routine with 
that obtained using the jacknife routine the following was 
done. The jacknife estimate of the coefficient of variation 
for the 16 groups is -4.5053 (column 1). The jacknife esti- 
mate of the standard deviation divided by the square root of 
16 is .3894 . Using a= .05, the t value with 15 degrees 
oieibreedam is 2.131. Thus, the 95% confidence interval for 
the coefficient of variation for telephone data 1 is 4.5053 
peeeeoo os (2-131) which is (3.676, 5.335]. This compares 
with the confidence interval of [3.454, 4.781] using the sec- 
tioning routine described in section IV. Likewise, confi- 
dence intervals on the remaining six statistics could be ob- 
tained in a similar manner. Note that the values obtained 
for the skewness coefficient from the sections are now not 
evidently biased; of the 16 values, 7 have values below the 


value 7.1531 for all the data. 


D. USAGE WITH COST OVERRUN DATA 

To demonstrate how the complete jacknife could be used 
and whv it is better to use when possible, the following was 
done. The 22 data points of the cost overrun data were used 
with the jacknife routine (HISTJACK). When HISTJACK was 
typed the data was entered in the variable YROVR and 22 was 
typed as the number of groups. By typing 22, which is the 
Same as the number of data points, a complete jacknife was 


done. 
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Looking at the output from the complete jacknife (figure 
9), the cost overrun data can be studied. One can note that 
Dy using the complete jacknife the mean, median, and variance 
of the jacknife estimate (column one under Summary for jack- 
nifed data) are the same value as the ungrouped mean, median 
and variance. But, also note that the coefficient of varia- 
tion is less than zero which can happen when using the jack- 


nife technique. 
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Vice K PONENT ial POOrTING ROUTINE 


Pee BESCRIPTION 

The fifth routine presented is an exponential Oar cae nti 
routine. Routine EXPONP is away of plotting the data to 
see if it "fits" an exponential distribution, and also to 
give some indication of what alternative distributions could 
be usedif the exponential hypothesis is rejected. 

A complete description of how EXPONP operates is con- 
tained in the variable EXPONPHOW . When the user types 


EXPONPHOW the following response is printed on the terminal. 
EXPONPHOW 


SL wnAx SEA PONP 


EXPONP ORDERS THE DATA X(I) AND COMPUTES 
THE EMPIRICAL LOG SURVIVER FUNCTION FOR THE DATA. 
JE oll Ge Gores 


\ / ee 
x ed, = ----- | 
Oe | | 


THE ORDERED DATA IS PLOTTED AGAINST THE LOG SUR- 
VIVER FUNCTION TO SEE IF THERE IS A LINEAR FIT. 
BPaeeer ALSO ALLOWS YOU FO TITLE YOUR PLOT. 


B. USAGE WITH TELEPHONE DATA 1 
EXPONP was used with telephone data 1 to see if the 
data plotted as a relative straight line. When EXPONP was 


typed the following responses were entered. 
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GO ee 
Meee Ove OHOERS THR DATA YOU GIVE AND COMPUTES THE 
PerermCALeeLOG SURVIVER FUNCTION FOR THE DATA. 
pee OP THE EOG SURVYIVER FUNCTION FOR THE DATA 
woeeveoveeeH NITED TO SEE fF THERE IS A LINEAR FIT. 
Ween TO Tithe YOUR PLOT TYPE YOUR TITLE. 
WeeyoOU DO NOT WANT A TITLE JUST HIT THE CARRIAGE 
RETURN. 
PEEEPHONE DATA 1 
mre OUR OATA IN VECTOR FORM™ 
a 

TELDATI 


Looking at figure 10 (plot of telephone data 1 using EX- 
PONP ), it was found that the data did not plot linearly from 
the origin, but that the data did appear somewhat linear in 
-the tail (5,000 to 90,000 range). 

C. USAGE WITH RANDOM GENERATED EXPONENTIALLY DISTRIBUTED 

SAMPLE WITH MEAN SAME AS TELEPHONE DATA 1] 

As a comparison, EXPONP was used with an exponentially 
generated random sample with the same mean as telephone data 
imecmauveslij. As expected, this plot is, within limits of 
sapien luctuiations, linear from the origin and in fact, what 
telephone data 1] would have looked like if the data was truly 
exponential. The quantization because of the coarseness of 
the APL type-ball is evident in this plot. The sample size 


is 672 , but not all these points can be plotted separately. 
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VIT. NORMAL PLOTTING ROUTINE 


A. DESCRIPTION 


The final routine presented is a normal plotting routine. 
Routine NORMP is a way of plotting the data to see if it 
"fits" a normal distribution. In particular one might want 
to look at estimates of descriptive statistics obtained from 
sections and groups in routines HISTS and HISTJACK 

A complete description of how NORMP Operates 1S con- 
tained in the variable NORMPHOW . When the user types NORMP- 


HOW the following response is printed on the terminal. 


NORMPHOW 


SYNTAX NORMP 


NORMP ORDERS THE DATA X(I) AND COMPUTES THE 
INVERSE OF THE UNIT NORMAL CUNULATIVE DISTRIEAU= 
yous, THAT IS, 


Vy fea / eels 
a ae | 
TC CD 1 \ We. / 


VVERSE OF 
THE ORDERED DATA IS PLOTTED AGAINST THE I) 

THE UNIT NORMAL CUMULATIVE DISTRIBUTION TO SEE 
IF THERE IS A LINEAR FIT. WORMP ALSO ALLOWS YOU 
MOmeCONVIENTLY f£ITLE YOUR PLOT. 
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B. USAGE WITH COST OVERRUN DATA 
NORMP was used with the cost overrun data to see if 
the data plotted as a relative straight line. When NORMP 


was typed the following responses were entered, 


NORMP : 
WORMED ORDERS THE DATA YOU GIVE AND COMPYCRS TYE 
BeVERGe OF THE UNIT NORMAL CUMULATIVE DISTRIRU- 
TeNeHOR THE DATA. A PLOT OF THE INVERSF OF THE 
[em ORUAL CUYULATIVE DISTRIBUTION VS THF ORDFR- 
ED DATA IS THEN PRINTED TO SFE IF THERE IS A 
buaaAn Fit’. 
mmo one TO TITLE YOUR PLOT TYPF YOUR TITLS, 
memo wor WANT A TITER JUST PIT THE CARRIAGE 
Ren Re . 
Gor eOVERRUNS 
VoemeevouR DATA IN VECTOR FOP 


i 
YROVR 


Note that the cost overrun data was contained in the 
Tiriabpte sYROVR . Looking at figure 12 (plot of cost over- 
run data using NORMP ), it was found that the data did in 
Pieemmnovetdiriy linear through the range -14 to 26 (for- 
mal tests are available; see Wilk & Gnanadesikan, 1968). 

C. USAGE WITH NORMAL SAMPLE GENERATED WITH MEAN AND 

VARIANCE THE SAME AS COST OVERRUN DATA 

As a comparison, NORMP was used with a normal sample 
with the same mean and variance as the cost overrun data 
(jigure 13). As expected, this plot is very linear. But 
again, this plot is not that much different from that of fig- 
ure 12, which gives credence to the fact that the cost over- 


run data might in fact be normally distributed. 
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D. USAGE WIH COEFFICIENT OF VARIATION DATA OBTAINED 
FROM USING SECTIONING ROUTINE 


In order to check for normality in the sectioned esti- 
mates obtained from using HISTS (sectioning routine) the 
following was done. The 16 coefficient of variation 
values obtained from using HISTS with telephone data | 
eoninn 5, figure 7) were entered as a vector into NORMP 
Figure 14 shows that the plot is marginally linear. This 
demonstrates the need for formal tests to verify normality 
in the absence of a strictly linear plot (Wilk & Gnanadsikan, 


IGS). 


ul. 
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VITI. JHE INDEPENDENCE AND MARKOV CHAIN 
Ome Ses enon) HeaiELEPHONE DATA 

The telephone data used in the thesis (Lewis & Cox, 1966) 
actually consists of binary bits transmitted over telephone 
Tines and the information that the bit transmitted at time i, 
M_-Ogey... 1S In @rror or net. This information is 
characterized by a sequence of binary-valued random variables 
oie —-eOsl.... Where x(i)=] means that the bit trans- 
mitted at time i is in error, while x(i)=0 means that the 
bit transmitted at time zero is COrreculyatransiii ted. 

In telephone data 1 there are 6/72 ones and 1,105,476 
zeros, and a much more compact and equivalent representation 
of the data is obtained via the sequence of random variables 
Pas Jal, 256 where y(j) is one plus the number of cor- 


rectly transmitted bits between the ie 


and (4 eee bit error. 
with the convention that y(j)=1 if the errors occur on adja- 
cent transmitted bits, and y(1) is the time from i1=0 to the 
first incorrectly transmitted bit. The y(j) are called the 
times-between-errors. 

A null hypothesis for the error structure which could be 


examined is that errors occur independently at each bit with 


fed probability, i.e. 


Pit i) 1} 
P{x(i)=0} 


i 

4 
W7—“, 
nd 
~~ 


=O) yal ene 


i 

=a 
~— 
© 
— 

i 


l-7(1) TO Geer 
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The y(j)'s then are independent and geometrically dis- 


tributed, since 


pay ij)=-1} = PLlif fea Sigon edb. timer ; gth aie 


time i+]} 


= 1(1) 


P{y(j)=2} = P{if ce error at time i; ad at 
time i+2} 
= m(1)Cl-7(1)] = 1(1)7(0) 
th 


P{y(j)=k+1} = PLif (j-1)5* error at time i; 7°" at 
time itltk} 


= n(1)[t-0(1)]* = r(1)[n(0)]* 


Note that, using the geometric series summation formula, 


= oh) nn ae 
2 a * en) 3! 
ELy(3 = 2. kPty(j == i” = =a 


Now assume that the Markov structure of the zero's and 


Ones is described by the transition matrix 


Bird:..0 ) O51) 1) (1-p)7(0) 
P = 
pial, 0) 1) o+(1-9)7(0) 
Here P(m,n) = P{x(it1) x(i)=m} , and we have para- 


Mmeterized the chain in terms of the stationary probability 
of a one or zero, and a correlation parameter O<p<l . Note 


that there are only two degrees of freedom in the stochastic 
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matrix, Since rows must sum to 1, and there is only one de- 
gree of freedom if the stationary probability 1(0)=1-7(1) 
mnie ad. Wote that the stationary probabilities in the 2- 


State case are given by 


We now define the runs of ones or zeros i.e. for 2£=0 or 


T) =e inevemexattn) 7 2t= 1, 


the length of a run of &'s,starting after time i, where the 
nomen can be O,1,2,... 

For example if x(itl)=1 , then the length of runs of 
Zerosmatadrcing after time i is zero, the length of runs of 
Ofessis at least one long. Note that it is possible to talk 
iaeaeconditional runs structure, i.e. the length of a run of 
ones which is given to start after time i. The run length 
icmemenmac least one long. 

Now the probability of a run T having length greater 


My 
meianeek. is, Using the Markov property, 


eK) P{x(G+1)=x(it2)=...x(itk)=etem(2)[P (2,2) 1°" 


Keel sree 


and P{T, =O} = l-n(2) 


Thus, the run lengths are geometrically distributed and 


<= : ie! : 1 (2) 
ECT(2)] = 2y ae - eos l-p)L1-7(2 


ou 





Note that p=0 gives the independence case, and while 
the runs of ones or zeros are geometrically distributed for 
both the independence or Markov dependent model, the mean 


run length is always longer for the Markov dependence, since 


(2) Y 
TaytT=TtEyT 2 foray Ose 


Thus, we could use the distributional properties of the 
runs to (1) check that either hypothesis is tenable or (2) 
if so, compare the estimated run lengths with the mean length 
7m(2)/[1-7(2)] predicted by the independence assumption. If 
the run lengths are not geometric, than another model must be 
postulated. 

Note that when this mean time-between-errors is large as 
it is for telephone data 1 (figure 1; ELy(j)]= 1,548) the 
discreteness of the time scale can be ignored and the geometric 
distribution is indistinguishable from its continuous time 
analog, the exponential distribution. 

That 1S approximation of the geometric distribution by 
an exponential distribution is valid can be seen from the 
fact that there are 672 errors (x(i)'s equal to one) in 
1,106,148 transmitted bits, so that an estimate of m(1) , 
which 1S the maximum likelihood estimate under the independence 


hypothesis, is 


Ghee ae - ¢# x(i)'s = 1] 
tormaler bats transmitted # x(i)'s=1+#x(i)'s=0 


OZ 





In the present data 


Ge ene = 0006075 


1,106,148 

Now this geometric hypothesis will be examined, but it 
is clear from figure 1] that the hypothesis is not true. The 
distribution is in fact highly skewed and has been examined 
Oyetewis & Cox, 1966. 

An alternative model to independent bit errors is that 
the dependence structure is Markovian. One could examine 
this hypothesis with time-series methods but a method which 
is adaptable for use with the histogram routine and which ex- 
amines both the independence and Markov assumptions is to 
look at runs of ones and zeros in the x(i). Under both hypo- 
thesis these runs have geometrically distributed lengths. 

The alternating conditional runs of ones for. telephone 
data 1 are shown in figure 15 and for runs of zeros are shown 
in figure 16. Also, HISTLIST was used on the conditional 
runs and figure 17 shows the runs of ones and figure 18 shows 
tre vmuns Of Zero. 

To test the hypothesis that the runs of ones in telephone 
data 1 is geometrically distributed the following was done. 


Using figures 15 and 17 the following data was obtained: 


MEAN ahaa 5294 # of runs = |] = 444 
VARIANCE = .346008 # of runs = 2 = 81 
HOt eGUnNSe=nog =) 15 
# of runs = 4 = 1 
7 of runs = 5 = 2 
Ot eins 0 = 1 
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FIGURE 17 
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FIGURE 18A 
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If the runs of ones are geometric then Probie k} = 


k=] ; 
gia )'p nce teers. this 1s the “geometric plus 
one" distribution. : 
a x ] 
u = ELX] = 
| = 5p) 
o?= VAR[X] = —+—, 
= ()) 


VARLX]? _ 
ELX] 


lomrind p set E{X] 


i 
mat 


.235294 = 1/(1-p) 


p O04 


Therefore, if the data is "geometric plus one" then 


2 


EXPECTED VAR[X] ~1904761/(.8095329) 


2906572 


Thus, the expected variance is .2906572 and the observed var- 
iance from HIST is .3460080 . Also, the expected coefficient 


See variance is 


EXPECTED C(X) = (.1904761)% = .4364356 


And, the observed coefficient of variation is .4/61817 
Therefore, at this point there seems to be a fairly close 
agreement between the runs of one and a "geometric plus one" 
distribution with p = .1904/761 
As further proof a Chi-square test for goodness of fit 
was run on the runs. By using the formula 


-| 


prob {X = x} = Glen fi OsYge ml eve 05th sO sees vs 
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PROBABILITY Eee ey OBSERVED 


P(X=1) = .8095239 440.38 444 
P(X=2) = 1541949 83.33 31 
p(X=3) = _0293704 15.98 15 
P(X=4) = .0055943 3.04 
P(X=5) = .0010655 sce eee 
P(X>6) = .0002510 "14 


Note, to use Chi-square not more than 20% of the cells 
Should have expected frequencies less than 5 and no cell 
Should have an expected frequency less than one. Therefore, 


the above frequencies must be combined into 3 cells. 


2 
eeeou Sem exe) 
x° =) mann = 1562799 
i=] ex. 
‘ 
And, x‘oc 5 = 5.99. Thus, the null hypothesis that the 
runs of one are "geometric plus one" with p = .1904761 can 


not be rejected. 
A similar procedure was done with the runs of greater 
than one. By using figure 15 the following information can 


be obtained: 


MEAN = almberce, 
VARIANCE = 59,064,970 
COEF.VAR.= 4.021082 


And, by using the same method as previously done and solving 


feumepemene gets p = .9994/6/ . 


EXPECTED VAR[X] = .9994767/(.0005233)¢ SOO aici 
This expected variance differs greatly from the observed 


Variance. Also, the expected coefficient of variation 1s 


ws 





computed to be 
EXPECTED C(X) = (.9994767)% = .9997383 


This compares with the observed coefficient of variation of 
4.021082 . Because of the gross departures of the variance 
and the coefficient of variation in the geometric hypothesis, 
One can conclude that the runs of length greater than 1 are 


not geometrically distributed. 


Pe 





IX. DOCUMENTATION ON ROUTINES 


A. LOCATION IN APL LIBRARY 

The descriptions and routines that have been presented 
are all available in the APL workspace library 2 DATALFNS 
Providing the user is properly logged on the terminal and.in 
Giementee mode, all that is necessary is to type )LOAD 2 
DATALFNS . If the user then types DESCRIBE, a short descrip- 
tion of the six routines presented and instructions on how 
to obtain the detailed information that is available in each 


of the "HOW" variables would be printed. 


B. WORKSPACE LOADING PROCEDURES 

Each of the routines was designed to stand alone. That 
iceeeyt the user desires just to use HIST , all that 78 neces- 
Sary is to type )COPY 2 DATALFNS HISTGRP into a clear work- 
Space.) HISTGRP contains the principal routine HIST and 
only the additional routines necessary for HIST to operate. 
Thus, the user does not clutter his workspace with any un- 
needed functions. It is this group structure that maintains 
the orderliness of the workspace. And, the ability to copy 
a particular group into a clear workspace provides more space 
for data and executions of the functions. 

iiemeonlowing 1S the group structure tn library 2 


DATALFNS 


qe 





PRINCIPAL OTHER NECESSARY 





GROUP ROUTINE ROUTINES VARIABLES 
HISTGRP ST APLNAME ,APLOT,AUTOS, 
CMS ,DFT,ECDF,ECODE, 
EFT,OF,OUT,WRITE 
fest IT STGRP mr TST APLNAME,CMS,ECODE, 
DFT,OF,OUT,WRITE 
HISTSGRP HISTS DFT,EFT 
HISTJACKGRP HISTJACK Oral fener Oo) 
EXPONPGRP -EXPONP AND,AUTOSCALE, BS 
INITIAL,MPLOT,MSGS, 
VS ,MULTIPLOT,SETAAP, 
TICMARK 
NORMPGRP NORMP AND,AUTOSCALE, 5S 
INITIAL,MPLOT,MSGS, 
VS ,MULTIPLOT,SETAAP, 
TICMARK 
DESCGRP (Descriptive group) DES RB Bynes Prien 
Bley 0 al (eee pss ie ee peso 
HOW ,HISTJACKHOW, 
EXPONPHOW,NORMPHOW 
VARIGRP (Variable group) TELDAT) , TEekeArZ 
YROVR 


WeeeeounINe LISTING 

The above mentioned routines were either created by the 
author, adapted from existing fortran routine HISTG/F , or 
borrowed from the current APL library to supplement the 


auenow ereated routines. 
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1. Author Created Routines 


HISTLIST, HISTS, HISTJACK, EXPONP, NORMP, APLOT, 
pues, OUT, TOT 


2. Adapted from Fortran Library Routine HISTG/F 
hls eo DF 


Borrowed Routines to Supplement Author Created 
Routines 


AND, APLNAME, AUTOSCALE, CMS, DFT, ECODE, EFT 


3 


INITIAL, MPLOT, MSGS, MULTIPLOT, NDTRI, OF, SETAAP, TICMARK, 
VS, WRITE 


vies. 





X. COMPUTER LISTING OF ALL ROUTINES 


SOLNV 
Viavl/(OxCE IvvOz(Z]yvOx[T Iy¥)< 


CUVCOXVIX+X) +E UZI9-C OXI) X+£ 2719) +[ 20 Jo? vege 


X/( CCE WWSX)v(CZIvZX) +x 


VEaVl/ (047 )+? Pav 


Gage EGG 

NIdV JLIYM (414402) 

sTd7Td¥ LSIH FISVYIs, SWI 

\A td ddTd¥ LSTH, JINVNIdV+NTd¥ 

ravVL/(0=70)¢. 

096249 

h ©. 7c og 

[)+70 

CHLGIM = =WAWIXVN GHL NO SI ONTLLIS 3DVd FDVIYNVD STYNIWYIL. 
sUNOX BUNS FG OO Gad NOX AI 3FLON) ° OF JdXL *TVNINNAL, 
sYNOX NO UVIddV OL LNdLNO UNOK INVA NOX AI * UW ddd 
V°YIINIYd FINITAIO GHL NO YVAddY OL LNdLNO YNOX INVA NOK dl, 


‘ 6 

[+2 

s° 0 VdXL *WVYDOLSTH FHL NI GaaNTONI SLIWI1, 

8FTVIS FHL FAGISLNO VLVd FHL LNVA LON OG NOK “*YFAGMOH AI *° ty, 


V\FdXL *OSTY JIVISOLNV AILYNDISHIA NOX AI * 1 GdXL *STTII. 
sGNG FHL NI SLIWIT ATVIS UNOX IAISLNO 9A SFHDIN LVL SENIOd, 
WVLVO FAUNTONT OL “FIVIS NMO UYNOK LIS JAVH NOK LVUL NAIAID, 
4 4 

O+¥ 

.° 0 00 YILNI ITVIS XITVITLVWOLAV OL LSTH INVA, 

sNOX AL “YAAAMOH “INTOd FTVIS LHOIYN UNOX NAHL ANY 3OVdS V Xa 
6G4YMNOTTOd LNIOd ATVIS LAXIT YUNOX NIHL ANY JIVdS V XG GIMOTION, 
(82 GNY OU NWAFIMLIE UFOILNI NV) $7799 30 UFAWNN BNL LSYIA, 
sYddNI FITVIS FHL GNVY ST7199 dO UIGWNAN BNL LIS OL LNVA NOX Al, 


fil 


é 
"NYNDAY AOVINNVOD FUL LTH LSNC ATLIL ¥Y INVA LON Od Nok roe 
SITET L YNOX AdXL NVYOOLSTH HNOX BAILIL OL LNVA NOX ddI. 


[}+4@ 

s 0 YV YIING LI INVA JON OG NOX AT ~* +t Va 

sYILNA NOTLINAA XLISNAG TWOTYTANY AANLOOWS V INVA OSTV NOX als 
6 $ 

. +X 

sWHOd YOLIAA NI ViVG foe 

Td, 


HG tOteg ZA Tat THP tthe Pre? 2VP UP t Zt TaIGVIX! LL? PWNS! YWNSE WANS! TONY ZW TNS TIVOSHE AS VLTIOS AS OL Gt NIaAVi VSS XS ASW SI 


4COILSTHA 


© 





O+(OTIJI: 2ZaVrus 

, 9+4hNS 

O-[ ht JO nave, 

ZTAVL/CLXIV/ (X= OX/ +4A/ JHN=A) VXAA/CTUSCN )O( AIG) ) +ERISC AT II<N D+ 
naVL/(OO0E<N)+? Gv 

L+ENNS*YNNS 

(CX#t)/+)#tN*CL)9 

(N4((X¥®)/+))¥+(9)9 

a@v.iL/COS(t XY) 

L+Gnns 

S*+VYNNS 
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